Multi-Channel Video Segmentation

A video is a multimedia document which is structured in scenes and shots. Scenes are lists of consecutive shots characterized by common visual and audio features. Shots are sets of consecutive frames separated by cuts, which can be easily recognized by existing techniques. Video segmentation into scenes is a new and open problem. It is needed for scenes retrieval, specially in authoring and interactive video applications. We propose a new approach of video segmentation into scenes, which is based on several media and takes into account the film syntax: * We characterize a scene by some similarity between color histograms of the current shot, and of one of the most recent previous shots (shot (t-1), shot (t-2), etc...). Similarity between a shot frame and a frame of a previous shot may indicate the presence of alternate shots, which belong to the same scene. Other techniques based on Projective Geometry are presented in a companion paper 1 . These techniques enable to detect the movemen..